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This  paper  discusses  the  concept »  origins,  and  some  of 
the  applications  of  linear  programming.  ( 
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CONCEPTS,  ORIGINS,  AND  USE  OF  LINEAR  PROORAMMINO 

George  B.  Oantzig 

1 .  CONCEPTS 

Too  often  linear  programming  is  introduced  by  citing  a 
number  of  miscellaneous  examples  that  appear  to  have  little 
in  comnon  except  that  their  mathematical  description  requires 
a  solution  of  a  system  of  linear  inequalities  that  minimizes 
(or  maximizes)  a  linear  form.  Conceptually  linear  programming 
is  concerned  with  building  a  model  for  describing  the  inter¬ 
relations  of  the  conq;>onents  of  a  system.  It  has  a  certain 
philosophy  or  approach  to  model  building  that  has  application 
to  a  broad  class  of  decision  problems.  Since  this  inq>ortant 
aspect  of  linear  programming  has  not  been  receiving  enough 
emphasis,  we  shall  begin  with  a  review. 

The  first  step  in  building  a  model  consists  in  regarding 
a  system  \mder  design  as  composed  of  a  number  of  elementary 
functions  that  are  called  "activities'*  (von  Neumann^  used  the 
term  "process”  while  T.  C.  Koopmans^  coined  the  term  "Activity 
Analysis”  to  describe  this  approach).  The  multitude  of  different 
type  activities  in  which  a  system  can  engage  constitutes  its  tech¬ 
nology;  these  are  the  representative  building  blocks  that  can 
be  recombined  in  varying  amounts  for  form  a  new  system.  The 

1 

J.  von  Neumann,  ”A  Model  of  General  Economic  Equilibrium,” 
Review  of  Economic  Studies,  Vol.  XIII  (l).  No.  55 1  1945-46, 
pp.  1-9. 

^"Activity  Analysis  of  Production  and  Allocation,”  T.  C. 

'  Koopmans  editor,  Wiley  and  Sons  publisher,  1951.  The  formulation 
of  the  linear  programming  model  can  be  found  in  Chapter 
”The  Programming  of  Interdependent  Activities — Mathematical 
Discussion”  by  George  B.  Dantzig. 
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quantities  of  different  types  of  activities  to  be  performed 
by  the  new  system  is  called  its  program.  It  becomes  a  feasible 
program,  if  the  structure  reared  by  the  blocks  is  mutually 
self-supporting  and  consistent  with  the  inputs  available  from 
outside  the  system  and  the  outputs  required  to  be  produced  by 
the  system. 

As  for  the  building  blocks  themselves,  each  activity  is 
viewed  as  a  kind  of  "black  box"  in  which  the  quantities  of 
various  items,  such  as  supply,  people,  money,  and  machinery, 
that  flow  into  it  are  transformed  into  different  quantities 
of  items  that  flow  out.  The  black  l^ox,  of  course,  is  a  myth. 
What  we  mean  is  that,  given  the  stated  input  flows,  we  have 
the  technical  know-how  to  combine  them  to  produce  the  stated 
output  flows.  For  example,  in  the  refining  of  crude  oil,  a 
simple  distillation  activity  of  a  certain  type  crude  might  be 
characterized  by 


Inputs 


Distillation 


- ^  i 

1  bbl  crude/day 
1  bbl  heater  capacity 
$1.80 


V 

/ 


Activity 


/ 


Outputs 

- > 

,.55  bbl.  fuel  oil 

.20  bbl.  diesel  oil 

.25  bbl.  gasoline 
components 


It  seems  q\ilte  reasonable  to  suppose  that  if  twice  (or 
any  positive  multiple)  of  the  input  flows  were  made  available 
that  the  same  technical  know-how  could  be  used  to  produce 


corresponding  multiple  of  output  flows.  Thus  distilling  twice 
as  many  barrels  of  crude  per  day  would  use  twice  as  many  barrels 
of  crude  per  day,  would  require  twice  the  distillation  capacity, 
would  cost  twice  as  much,  and  would  produce  twice  as  many  barrels 
of  fuel,  diesel,  and  the  lighter  type  oils  (which  are  used  as 
components  in  the  blending  of  gasoline  stocks).  It  is  this 
proportionality  aspect  more  than  any  other  that  characterizes 
the  linear  programming  model.  Assuming  its  general  truth 
within  a  model,  it  is  natural  to  consider  all  activities  that 
can  be  generated  as  a  multiple  of  a  fixed  activity  as  forming 
an  activity  type;  each  activity  within  the  type  is  characterized 
by  the  multiple  of  the  fixed  activity  called  the  "activity  level." 

Associated  with  each  item  that  can  flow  into  or  out  of 
each  activity  is  a  material  balance  equation.  To  be  precise, 
for  each  item^  it  is  required  that  the  total  amount  on  hand 
equal  the  mount  flowing  into  the  various  activities  minus 
the  amount  flowing  out. 

Finally,  one  of  the  items  of  the  system  Is  regarded  as 
precious  in  the  sense  that  the  total  amount  of  it  produced 
by  the  system  measures  the  payoff.  The  progranming  problem 
consists  in  determining  values  for  the  activity  levels  which 
are  positive  or  zero  such  that  the  flows  of  each  item  (for 
these  activity  levels)  satisfies  the  material  balance  equations 
and  such  that  the  value  of  the  payoff  is  maximum. 

These  steps,  if  followed,  lead  to  a  well-defined  mathematical 
model  of  the  system,  called  the  linear  progranming  model. 
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Indeed,  let  the  subscript  J  «  1,  2,  n  denote  the 

type  activity  and  Xj  its  quantity;  let  the  subscript  i  denote 

tih 

the  i  type  item  and  a^^  denote  the  input  of  the  i  type 
item  into  the  type  activity  per  unit  quantity  of  activity 
(a^j,  if  negative,  denotes  output  instead  of  input);  let 
denote  the  given  available  input  to  the  system  from  exogeneous 
sources  (b^,  if  negative,  denotes  the  required  outputs  from 
the  system)  •  The  material  balance  equations  then  become 

®ll*l  *  *12*2  +  •••  ♦  »in*n  ■  **l 

*21*1  *22*2  +••••►  *2n*n  "  **2 


®Jnl*l  *  *m2*2  +  •  •  •  +  ®iiin*n  ” 

where  the  term  denotea  the  total  flow  of  the  1^"  Item 

a.  w 

into  the  J  type  activity  if  its  activity  level  is  Xj  e  For 
the  precious  item  let  Cj  denote  the  '^cost”  per  unit  level  of 
activity;  then 


(2)  CjXj  +  CgXg  +...•*■  CjjXj,  -  z 
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measurea  the  total  systtm  coats  (— z  measures  total  payoff). 
The  linear  prograimning  problem  then  consists  in  choosing 
numbers 


(5) 


Xi  >  0,  Xg^O,  ....  x„  >  0 


satisfying  (l),  such  that  the  value  of  *  given  by  (2)  is 
minimum. 
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2 .  ORIQINS 

ECONOMIC  ORIQINS  OP  LINEMl  PROORAWCItQ 

Linear  prograjnming  is  an  anachronism ,  Logically  it  should 
have  begun  around  1760  when  economists  first  began  to  describe 
economic  systems  in  mathematical  terms.  Thus  a  crude  example 
of  a  linear  programming  model  is  found  in  the  "Tableau  Bconomique 
of  Qiesnay^  who  attempted  to  interrelate  the  roles  of  the  land¬ 
lord,  the  peasant  and  the  artisan.  During  the  next  175  years 
there  was,  however,  little  in  the  way  of  exploitation  of  a 
linear-type  model  although  it  did  appear  as  part  of  the  Walrasian 
system  in  the  l870's.  For  the  most  part,  mathematical  economists 
made  use  of  general  functions  whose  parameters  were  as  a  rule 
unspecified.  In  their  defense,  it  should  be  remembered  that 
very  little  in  the  way  of  facts  wex«  available  on  income, 
quantities  of  production,  investments,  savings,  distribution, 
etc . ,  so  that  the  purpose  of  the  mathematical  equations  was  to 
describe  in  a  qualitative  rather  than  a  quantitative  way  the 
assumed  interrelations  within  a  system  while  the  manipulation  of 
equations  corresponded  to  logical  deductions  from  the  assumptions 
The  first  major  impetus  to  the  construction  of  practical 
mathematical  models  to  describe  an  economy,  casM  about  in  the 
1950*8  as  a  result  of  the  great  depression  for,  with  the  advent 
of  the  "New  Deal,"  there  was  a  serious  attempt  on  the  part  of 
the  government  to  support  certain  activities  which,  it  was  hoped, 
would  speed  recovery. 
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Wassily  Leontiaff  professor  at  Harvard,  brought  out  his 
book  "The  Structure  of  the  American  Economy**  during  this  period. 
This  marked  a  sharp  departure  from  earlier  model  building  be¬ 
cause  a  large  number  of  industries  (or  sectors)  were  inter¬ 
related  in  a  single  model  that  permitted  estimation  of  the 
parameters  in  a  practical  and  quantitative  way.  Each  **sector** 
represented  a  number  of  related  functions  that  were  lumped 
together  and  called  an  industry,  such  as  steel.  S(y  estimating 
the  dollar  sales  of  each  sector  to  every  other  sector  it  was 
possible  to  develop  a  so-called  input-output  model.  This  was 
done  by  assuming  the  dollar  input  of  products  into  sector  A 
from  B  was  proportional  to  the  dollar  output  of  sector  A.  The 
scope,  accuracy,  and  area  of  application  of  Leontief-type  models 
were  greatly  extended  by  the  Bureau  of  Labor  Statistics  in  the 
years  that  followed.  It  was  this  work  that  was  generalized  in 
the  post  war  period  into  a  fom  suitable  for  domamic  Air  Force 
applications . 

About  the  same  time  that  Leontief  was  producing  his  model, 
John  von  Neumann,  world-famous  mathematician,  published  his 
llodel  of  Economic  Equilibrium,**  (19^7)  •  His  model  (like  the 
Leontief  model)  was  a  linear  programming  model.  It  was  more 
general,  as  it  allowed  for  alternative  activities.  It  was 
completely  general  except  it  did  not  possess  a  general  objective 
form.  His  purpose  was  limited  to  proving  a  relation  between  the 
expansion  rate  and  the  interest  rate  on  money  for  a  constantly 
expanding  economy.  As  far  as  influence  is  concerned,  this  paper, 
like  many  others,  had  for  purpose,  an  interesting  mathematical 


theorem.  Ihere  Appears  to  have  been  little  interest  in  the  model 


itself  among  economists,  for,  according  to  T.  C.  Koopmans,  "To 
many  economists,  the  term  linearity  is  associated  with  narrowness 

ml 

restrictiveness,  and  inflexibility  of  hypothesis." 

However,  it  was  the  broad  applicability  of  the  linear 
programming  approach  to  military  planning  that  stimulated 
economists  during  the  post  war  period  to  recognize  the  poten¬ 
tialities  of  this  type  model  for  studying  economic  problems. 


^"Introduction,"  Activity  Analysis  of  Production  and 
Allocation,  T.  C.  Koopmans  (aditor),  page  b. 


NIUTARY  ORIGINS  OF  PROGRAM  PLANNING 
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The  following  quotation^  from  a  paper  by  Wood  and  Qelsler 
traces  developments  in  the  military  area  through  World  War  II: 

'^It  was  once  possible  for  a  supreme  commander  to  plan 
operations  personally.  As  the  planning  problem  expanded  in 
space «  time 9  and  general  complexity »  however «  the  inherent 
limitations  in  the  capacity  of  any  one  man  were  encountered. 
Military  histories  are  filled  with  instances  of  commanders  who 
failed  because  they  bogged  down  in  details,  not  because  they 
could  not  eventually  have  mastered  the  details,  but  because 
they  could  not  master  all  the  relevant  details  in  the  time 
available  for  decision. 

^Gradually,  as  planning  problems  became  more  complex,  the 
supreme  commander  came  to  be  surrounded  with  a  general  staff 
of  specialists,  which  supplemented  the  chief  in  maxing  decisions. 
The  existence  of  a  general  staff  permitted  the  subdivision  of 
the  planning  process  and  the  assignment  of  experts  to  handle 
each  part.  The  function  of  the  chief  then  became  one  of  selec¬ 
ting  objectives,  coordinating,  planning,  and  resolving  conflicts 
between  staff  sections.” 

^The  quotation  that  follows  is  taken  from  a  paper  by  Marshall 
K.  Wood  and  Murray  A.  Geisler,  "Development  of  Dynamic  Models  for 
Program  Planning,"  Chapter  XII,  Activity  Analysis  of  Production  and 
Allocation ,  pp.  189-192. 
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In  the  U.S.  Air  Force,  for  example,  during  the  war  a 
group  under  the  guidance  of  Professor  E.  P.  Learned  of  Harvard 
Business  School  evolved  a  scheme  which  was  a  program  for  pro¬ 
gramming  by  means  of  which  the  work  of  many  staff  and  command 
agencies  participating  In  the  process  was  carefully  scheduled. 
In  order  to  obtain  consistent  programming  the  ordering  of  the 
steps  In  the  schedule  were  so  arranged  that  the  flow  of  In— 
formation  from  echelon  to  echelon  was  only  In  one  direction. 


Even  with  the  most  careful  scheduling.  It  took  about  seven 
months  to  complete  the  process. 

After  the  war  the  Air  Force  consolidated  the  statistical 


control,  programming  monitoring,  and  budgeting  functions  under 
the  Air  Force  Comptroller— General  E.  W.  Rawlings.  It  became 
clear  to  members  of  this  organization  that  coordinating  quickly 
and  well  the  energies  of  whole  nations  In  a  total  war  required 
scientific  programming  techniques.  Undoubtedly  this  need  had 
occurred  many  times  In  the  past  but  this  time  the  means  of 
accomplishment  were  at  hand — these  were  the  electronic  computer 
developments  and  a  new  way  to  describe  the  Interrelations  of 
a  complex  organization  so  as  to  permit  computation  on  electronic 
computers.  Here,  of  course,  I  am  referring  to  linear  programming. 

Intensive  work  began  In  June  1947  In  a  group  that  later 
(October  1948)  was  given  the  official  title  of  Project  *^COOP** 
(S^clentlflc  Computation  of  ^tlmum  Programs). 

V/hlle  the  Initial  proposal  was  to  use  a  linear  programming 
model  to  develop  Air  Force  programs.  It  was  recognized  at  an 


early  date  that  even  the  moat  optimistic  estimates  of  the 
efficiency  of  future  computing  procedures  and  facilities  would 
not  be  powerful  enough  to  prepare  detailed  Air  Force  programs. 
Accordingly,  in  the  Spring  of  19^8,  there  was  a  second  SCOOP 
proposal  that  special  linear  programming  models,  called  tri¬ 
angular  models,  be  developed  whose  computational  solution 
would  parallel  the  stepwise  staff  procedure.  Since  19^8  the 
Air  Staff  has  been  making  more  and  more  active  use  of  mechani¬ 
cally  computed  programs.  The  triangular  models  are  used  by 

them  for  detailed  programs,  while  the  general  linear  programming 

« 

models  are  used  in  certain  areas. 
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3 .  APPUCATI0N3 

It  18  of  course  impossible  In  a  brief  talk  to  do  more 
than  give  a  short  list  of  military  and  Industrial  applications 
and  to  Illustrate  briefly.  Military  applications  Include: 

1.  Optimal  routing  for  air  transport 

2.  Time  phased  distribution  of  supply  from  factories 
and  depots  to  bases 

3.  Allocation  of  electronic  equipment  to  naval  vessels 

4.  Production  smoothing  problems 

3.  Contract  award  problems 

6.  Communications  system  design  and  message  routing 

7*  Personnel  assignment  problems 

8.  Maximal  flow  In  transportation  networks 

9*  Minimal  tanker  fleets  to  meet  a  fixed  schedule 

Some  of  these  which  I  have  cited  represent  areas  where 
the  linear  programming  tool  has  been  proposed  or  has  been  used 
from  time  to  time.  Others,  like  the  production  smoothing, 
contract  awards,  suid  supply  distribution,  have  found  frequent 
application. 

In  the  spring  of  1951#  four  years  after  the  birth  of 
linear  programming,  Chames  and  Cooper  at  Cax^egle  began  to 
pioneer  Industrial  applications.  With  Bob  Mellon  of  Oulf  Oil 
Coiqpany,  they  were  the  first  to  develop  the  application  of 
linear  programming  to  refinery  problems.  This  has  since  proved 
to  be  the  most  fruitful  of  industrial  applications.  At  the 
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recent  Management  Science  meeting*  Qarvin*  Crandall*  John*  and 
Spellmann  reported  on  a  survey  of  applications  in  the  oil 
industry.  So  intense  has  been  the  development  in  this  area 
that  it  now  covers  every  phase  of  their  worki  (1)  exploration* 
(2)  production*  (3)  refining*  (4)  distribution. 

Next  to  the  petroleum  industry*  the  food  industry  is 
perhaps  the  second  most  active  customer.  Heinz  Company  uses 
it  to  determine  which  of  a  half  a  dozen  plants  should  ship 
ketchup  to  seventy  warehouses  located  in  all  parts  of  the 
country.  A  major  milk  producer  has  been  considering  it  as  a 
means  of  determining  which  of  its  dozen  or  so  milk  producing 
centers  should  ship  canned  milk  to  thousands  of  warehouses  in 
this  country  and  to  foreign  markets.  Armour  and  Company  use 
it  to  determine  the  most  economical  mixture  of  feeds  for 
animals . 

In  metal  processing  applications*  the  president  of  Argus 
Cameras  reports  a  savings  of  $34*000  per  quarter  because  the 
price  iiqplications  of  linear  programming  told  them  whether  to 
make  or  to  buy  a  part.  The  production  planning  manager  of 
SXF  says  that  the  linear  programming  helped  them  save  6*000 
machine  hours  each  month*  or  $100*000  per  year  over  the  Gantt 
Chart  Control  System  used  by  them  prior  to  1933* 

Important  explications  are  being  made  in  other  countries. 
Thus  the  Abitibi  Power  and  Paper  Company  of  Canada  and  the 
Australian  Paper  Manufacturing,  Ltd.  use  linear  programming 
methods  to  minimize  paper  machine  trim  losses.  It  is  also 
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applied  to  minimizing  transportation  costs  from  mills  to 

customers.  Recently  I  received  the  following  communication 

from  a  friend  visiting  in  England: 

There  are  some  very  nice  applications  around  — 

I  have  counted  a  dozen  myself^  although  only  two 
or  three  have  appeared  in  the  literature.  In 
general,  firms  are  keeping  their  activity  quiet 
for  the  usual  reason  that  Nacy's  does  not  tell 
Oimbel's. 

Elsewhere  he  says, 

A  very  lovely  application  was  developed  by  a 
statistician-economist  for  planning  the  operations 
of  one  of  the  divisions  of  Shell  Chemical.  It 
seems  to  increase  the  planning  profits  (based  on 
sales  estimates)  by  about  3^* 

There  are  two  interesting  fields  where  linear  programming 
is  Just  beginning  to  be  used: 

1.  The  first  was  discussed  at  the  1936  Managemer^  Science 
meeting  in  Los  Angeles  by  Dr.  Pierre  Mass^,  Executive  Vice 
President  of  the  Nationalized  Electric  Power  Industry  of 
Prance,  and  Dr.  R.  Oibrat.  They  showed  how  linear  programming 
could  be  used  to  decide  how  much  should  be  invested  in  new 
hydroelectric,  steam,  tidal,  and  atomic  plants. 

2.  The  second  was  discussed  in  the  October  issue  of 
Management  Science  by  R.  Kalaba  and  M.  Juncosa  in  their  paper 
on  the  application  of  linear  programming  to  optimal  routing  of 
messages  in  a  communications  network  cmd  to  the  problem  of 
investment  in  communication  facilities.  This  work  began  with 
the  military  application  but  recently  research  workers  in  the 
Bell  System  have  become  interested.  It  seems  to  offer  an 
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approach  to  overall  systems  studies  which  are  too  complicated 
to  handle  at  present  by  waiting  line  theory. 

For  Air  Force  applications  there  is  an  excellent  brochure 
prepared  by  the  United  States  Air  Force  Comptroller^that  lists 
a  number  of  typical  examples.  Prom  this  source  I  have  picked 
two : 

The  first  typical  example  is  a  transportation  problem. 
This  military  example  is  similar  to  the  Heinz  !Cetchup  example. 
Assume  that  Lockboume  Air  Force  Base  at  Columbus «  Ohio,  has 
been  testing  a  large  item  of  equipment,  weighing  a  ton,  for 
the  B-47*  It  is  now  desired  that  this  equipment  be  tried  at 
other  bases.  Suppose  that  five  each  are  required  by  three 
Air  Force  bases  and  three  each  are  required  by  the  two  others. 
To  supply  these  twenty-one  items,  Columbus  and  Oklahoma  City 
can  ship  eight  each  and  Wamer^-Aobins  at  Macon,  Georgia,  has 
five.  The  items  of  equipment  are  to  be  airlifted  to  their 
destinations.  The  problem  is  to  determine  the  routing  which 
fulfills  the  requirements  and  minimizes  the  total  ton-miles. 

There  are,  of  course,  many  possible  routings.  The  mini¬ 
mum  solution  can  be  obtained  by  one  of  several  methods  of 
linear  programming  that  are  ne4  available. 

The  second  typical  problem  concerns  production  versus 
requirements.  This  military  example  has  its  counterpart  in 
many  industrial  examples. 

In 

"The  Application  of  Linear  Frogramming  Techniques  to 
Air  Fbrce  Froblema  *  A  Non-^Pechnical  Discussion,*'  Report 
AFANA  3-^2,  prepared  by  Computation  DiTision,  Directorate 
of  Nanageaent  Analysis,  DCS/Coaptroller,  Headquarters  U.  S. 

Air  Force,  December  17#  195^* 
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Training  BchoolB  within  the  Air  Force  are  concerned  with 
the  efficient  production  of  grauluates.  In  order  to  meet  a 
schedule  of  future  requirements «  each  school  must  make 
available  the  required  number  of  trained  men  at  the  right 
time. 

Since  each  training  activity  has  its  own  limitations  wnd 
needs I  an  efficient  method  of  production  for  one  will  not 
necessarily  be  efficient  for  another.  Some  training  activities 
can  readily  increase  their  rates  of  output  while  others  can  do 
so  only  within  limits  and  at  substantial  cost.  Vfhere^  for 
example#  equipment  and  personnel  must  be  released  when 
production  drops  and  reinstated  as  It  expands#  large  fluctuations 
in  the  level  of  production  are  undesirable.  When  faced  with 
fluctuating  requirements#  such  an  activity  will  ordinarily 
overproduce  in  periods  of  low  requirements#  pool  the  surplus# 
and  use  the  excess  in  periods  of  high  requirements.  The 
production  pattern  can  thus  be  made  quite  stable.  However#  a 
solution  may  be  undesirable  if  it  yields  in  turn  comparatively 
large  monthly  surpluses  of  trained  men. 

Problems  of  this  nature  illustrate  the  difficulties  that 
arise  whenever  conflicting  objectives  are  inherent  in  a  problem. 
Here  the  desire  is  to  determine  a  schedule  that  tries  to  reduce 
both  large  fluctuations  in  output  and  large  monthly  surpluses 
of  men.  For  these  problems,  efficient  planning  means  the 
determination  of  a  middle  ground  lying  between  the  two  extremes. 
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The  optinuffl  production  schedule  will  depend,  of  course,  on  the 
relative  liqportance  assigned  to  the  conflicting  objectives. 


